Skip to main content

View Post [edit]

Poster: Jeff Kaplan Date: Apr 24, 2016 10:09pm
Forum: general Subject: Re: Am I using the http interface wrong?

did you actually create an identifier to be put in place of "IDENTIFIER" ?

Reply [edit]

Poster: Conjecture Date: Apr 25, 2016 4:18pm
Forum: general Subject: Re: Am I using the http interface wrong?

Sorry, I thought that was part of the api

Reply [edit]

Poster: pegzmasta Date: Apr 25, 2016 5:13pm
Forum: general Subject: Re: Am I using the http interface wrong?

Hi there fellow slacker! I thought I'd add a tip that might prove useful to you. It might take a while for cURL to transmit your ISO's to IA's servers (it did for me, since ISO files are usually very large), so if you want you can just command your computer to upload a torrent file (Slackware and similar websites provides these for their users) to IA which will inevitably auto-derive into an ISO file. If you don't have the actual torrent, then you could just send the magnet link into a ".torrent" file, and then the Archive will detect the torrent from your magnet. These are the commands I executed to upload an ISO file from freeslack.net (the first character, `$', represents your prompt):
$ curl http://freeslack.net/torrents/FreeSlack64-14.1-install-dvd.html |\
sed -n 's_.*href=.\(.*\)">.*_\1_p' > freeslack.torrent
$ curl --location --header 'x-amz-auto-make-bucket:1' \
--header 'x-archive-meta01-collection:test_collection' \
--header 'x-archive-meta-mediatype:software' \
--header 'x-archive-meta-language:eng' \
--header "authorization: LOW $accesskey:$secretkey" \
--upload-file freeslack.torrent http://s3.us.archive.org/pegz-s3-test-01/ && echo
Here is the details page for the item that I created using the IAS3API (you can modify the medadata using this API, as well): https://archive.org/download/pegz-s3-test-01
This post was modified by pegzmasta on 2016-04-26 00:13:03

Reply [edit]

Poster: Jeff Kaplan Date: Apr 25, 2016 9:34pm
Forum: general Subject: Re: Am I using the http interface wrong?

that is actually not a wise idea because the file you intended to upload will them be designated as a derivative rather than original file and we do not derive from derivatives.

Reply [edit]

Poster: PDpolice Date: Apr 26, 2016 1:41am
Forum: general Subject: Re: Can I use the http interface right?

Avoiding 'Derivatives' is one of my goals. The clutter of the mpg,mp3, ogg,fla, omg and other faddish file types is an unpleasant mess to many users.
Is there a way to upload a file and have the 'archive' leave my files as I intend them to be?

I have concerns that one day IAwill decide the current file types are no longer needed and use that smart gse file type that turned out to be not-lossless and content-critical after it was too late.

Reply [edit]

Poster: Jeff Kaplan Date: Apr 26, 2016 7:51am
Forum: general Subject: Re: Can I use the http interface right?

we encourage the creation of formats used by modern devices because we are a library with a mission to share usable content. if you don't want your data shared then this is not where your data belongs.

Reply [edit]

Poster: pegzmasta Date: Apr 26, 2016 4:51pm
Forum: general Subject: Re: Can I use the http interface right?

Whoah! I think we're headed in the wrong direction here. The moment we start telling users to pack up their items and leave, is the same moment that the Archive will start decreasing in value (in case this wasn't already obvious).

Take a step back, and read what PD has written. No where does he say he doesn't want to share his files (I remember receiving a similar response not too long ago). You do realize that a derivation can not even begin until the user has shared to the Archive at least one file. It is important for IA users to be able to share their files with the whole world, but to have the user sacrifice their freedom/control over their own files is never a good idea– they should be able to make administrative decisions about their own files. This isn't about user's not wanting to share their files; this is about user's wanting to have more control over their own files that are hosted here.

Users should have some more flexibility and control over their own items. Consider the leftover digital artifacts from the original programmers who had the same thing in mind (I know they did; otherwise these artifacts wouldn't exist):
  • Users would not even be able to reach a prompt that asks to "start" or "cancel" a derive, if no one thought that it was important to be able to queue or cancel a derive
  • The cancel button (yes, I screenshot it) for derivations wouldn't even exist, if someone at the Archive didn't think it was important for users to cancel a derivation.
  • The "To remove and/or prevent a particular derivative format" section on the Derivative Formats page wouldn't exist, if users were not allowed to have at least some control over derivations for their files (I understand that these advanced techniques are currently only to be used on lossy audio or movie files)
  • The official IAS3API documentation wouldn't have included documentation about a header like "x-archive-queue-derive:0", if the developers of the IAS3API didn't think it was important for users to have the ability to prevent the Archive from queuing a derive on their file via the command-line.


How many derivatives do you see listed in this "_files.xml" file:
https://archive.org/download/derivation-test/derivation-test_files.xml

Now compare the usefulness of the derivatives in that file with the original source files. Now imagine that certain users are against a particular format or all derivations in general (for whatever reason); does that mean that they should pack up and leave? Does rejecting derivatives truly decrease the value of the original work? Are users so incompetent that they can't figure out how to convert these original source files to other formats themselves? For instance, with FFmpeg users can convert one video file format into another; with Calibre, you can convert one E-Book format to any of the major E-Book formats (assuming that the source file is not infected with proprietary malware, like DRM).

The point is:
Even if a small amount of users can't access an item because there exists no derivatives for their modern device: Will we now shun the majority of users who can access the item, by sending the uploader packing? As with every post, this is worth thinking about; otherwise, I wouldn't have written this. Thanks for your considerations, and please deposit some useful and constructive thoughts to this thread.

Reply [edit]

Poster: PDpolice Date: Apr 26, 2016 11:45am
Forum: general Subject: Re: Can I use the door to the right?

Thanks for setting me strait. I will be posting the "Please delete collections" posting when I have removed the appropriate files.

Reply [edit]

Poster: Dupenhagen Moonbat Date: May 5, 2016 5:03pm
Forum: general Subject: No Jive

This experiment the Archive is conducting to see how many folks (and their digital [as distinct from financial -- which the Archive foolishly claims not to need any more] contributions) she can drive away with a big "Eff off!" in their face, is bizarre.

Thanks for your IAMarch 2016 Good upload, which I have saved to my drive. "This was what the Archive was before the patients took over the asylum."

P.S. That saving to drive was via Google Chrome's web page save feature, but just for grins I thought I'd try the "_archive.torrent," and (surprise) it didn't work. My being a big believer in the old saw, "If you want something done right, do it yourself," I've created an actually working torrent of the item, and made it available here as an attachment. Note the name "_no_jive.torrent."

Attachment: IAMarch2016Good_no-jive.torrent

Reply [edit]

Poster: pegzmasta Date: Apr 26, 2016 4:40pm
Forum: general Subject: Re: Am I using the http interface wrong?

I mainly posited the above post, in case the user was having any trouble with uploading the ISO file. When uploading a large file, if the user has a weak/slow internet connection, then the upload could be interrupted. A file needs to be re-uploaded when this happens– even if they reached 99%. With the BitTorrent protocol, this problem does not exist, so it is a good fall-back option for large files.

Reply [edit]

Poster: Conjecture Date: Apr 25, 2016 7:14pm
Forum: general Subject: Re: Am I using the http interface wrong?

Thanks, I didn't even know you could do that with torrent files.